Content reaction annotations

ABSTRACT

Among other things, one or more techniques and/or systems are provided for annotating content based upon user reaction data and/or for maintaining a searchable content repository. That is, a user may request and/or opt-in for user reaction data to be detected while a user is experiencing content (e.g., watching a movie, walking through a park, interacting with a website, participating on a phone conversation, etc.). Metadata associated with the content may be used to determine when and/or what sensors to use to detect the user reaction data (e.g., metadata specifying an emotional part of a movie). The content may be annotated with a reaction annotation corresponding to the user reaction data, which may be used to organize, search, and/or interact with the content. A search interface may allow users to search for content based upon annotation data and/or aggregated annotation data of one or more users who experienced the content.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.13/713,240, now U.S. Pat. No. 9,721,010, filed Dec. 13, 2012 and titled“Content reaction annotations;” the disclosure of which is herebyincorporated herein by reference.

BACKGROUND

Many users may have reactions, such as emotions, while experiencingcontent. In one example, a user may become upset while experiencing acongested highway. In another example, a user may have a range ofemotions, from happy to sad, while experiencing a movie. In anotherexample, a user may become frustrated while installing a new softwareapplication. After experiencing content, a user may submit a review ofthe content. In one example, a user may rate a trip to a state parkthrough a travel website. In another example, a user may write a productreview of a washing machine through a shopping website. In this way,users may share their reactions and/or emotions regarding content, suchas a movie, a website, music, an application, a geographical location, abusiness, an image, etc.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the detaileddescription. This summary is not intended to identify key factors oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

Among other things, one or more systems and/or techniques for annotatingcontent based upon user reaction data and/or for maintaining asearchable content repository are provided herein. That is, a user mayconsume (e.g., interact with) a variety of content, such as a movie,music, an application, a website, a geographical location, a business,an image, a book, social network information, an advertisement, aproduct for sale, a portion of a highway, interaction with a person, anemail, and/or a variety of other electronic and/or real-world (e.g.,tangible) content. In one example, the user may request and/or opt-infor detection of user reactions to content for various purposes, such asannotating the content based upon how the user reacted to the content.For example, the user may desire to organize, search, and/or sharecontent based upon how the user reacted to the content (e.g., the usermay search for images that made the user happy when the user initiallycreated and/or viewed the images). The user may specify a level ofsecurity for user reaction data and/or annotations created from the userreaction data (e.g., the user may specify that such information is to besecurely stored for use by merely the user, the user may specify thatsuch information may be aggregated with other user reaction data for useby a searchable content repository, etc.).

User reaction data associated with the content and/or a portion thereof(e.g., a segment of a movie, a region of an image, a stretch of highway,morning work emails, evening personal emails, etc.) may be detected. Forexample, a device (e.g., a mobile phone, a laptop, a tablet device,vehicle instrumentation, a television, an electronic billboard, and/orother devices) may comprise one or more sensors, such as a camera, amotion sensor (e.g., an accelerometer or gyroscope), a GPS device, amicrophone, and/or other sensors that may sense user reaction data. Inone example, while a user is viewing a first portion of email content ona tablet computing device, one or more sensors may detect a volume ofthe user's voice, facial expressions of the user, and/or movement oftablet computing device as first user reaction data for the firstportion of the email content (e.g., the user may become upset uponreading the first portion of the email content). In one example, one ormore user reactions may be collected in real-time (e.g., by one or moresensors), but at least some of these reactions may be processed on adifferent device and/or at a different time to determine or detect theuser reaction data. That is, user reaction data may be determined ordetected from a user reaction other than when the user reaction occurredor was captured by one or more sensors, for example (e.g., to conserveresources, enhance processing, etc.). The first portion of the emailcontent may be annotated with a first reaction annotation based upon thefirst user reaction data. While viewing a second portion of the emailcontent, one or more sensors may detect that the user is crying assecond user reaction data for the second portion of the email content.The second portion of the email content may be annotated with a secondreaction annotation based upon the second user reaction data, etc.

Various information, such as resource availability (e.g., battery life),metadata associated with a portion of content (e.g., metadataidentifying that the portion of content may have a reaction probabilityof emotion above a threshold), a location context of the tabletcomputing device (e.g., the user is at home vs. in a work meeting), acontext of the content (e.g., the user is reading an email while athome), a current time, and/or other information may be used toselectively activate and/or deactivate one or more sensors. In oneexample of metadata, offline analysis of movie content may identify oneor more portions of the movie content as having relatively high reactionprobabilities for invoking emotion (e.g., a car chase scene, a tragicdeath scene, etc.). Such portions may be annotated with metadata thatmay identify particular sensors that may be activated during respectiveportions of the movie, which may mitigate unnecessary resourceconsumption by sensors during those portions of the movie that may notproduce emotion, for example. In this way, content and/or portionsthereof may be annotated with reaction annotations that may be used torate, organize, and/or search for content based upon user reactions.

A searchable content repository comprising annotation data and/oraggregated annotation data of one or more users may be maintained. Inone example, the searchable content repository may comprise one or morereaction annotations by a first user for a tragedy movie. In anotherexample, the search content repository may comprise aggregatedannotation data derived from annotation data by a plurality of users fora comedy movie. In this way, a search interface may allow a user tosearch for content or portions thereof based upon user reaction searches(e.g., a search for portions of a movie that made users happy) and/orsingle user reaction searches (e.g., a search for images that made aparticular user happy).

To the accomplishment of the foregoing and related ends, the followingdescription and annexed drawings set forth certain illustrative aspectsand implementations. These are indicative of but a few of the variousways in which one or more aspects may be employed. Other aspects,advantages, and novel features of the disclosure will become apparentfrom the following detailed description when considered in conjunctionwith the annexed drawings.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flow diagram illustrating an exemplary method of annotatingcontent based upon user reaction data.

FIG. 2 is a component block diagram illustrating an exemplary system forannotating content based upon user reaction data.

FIG. 3 is a component block diagram illustrating an exemplary system forannotating content based upon user reaction data.

FIG. 4 is a component block diagram illustrating an exemplary system forannotating content based upon user reaction data.

FIG. 5 is a flow diagram illustrating an exemplary method of maintaininga searchable content repository.

FIG. 6 is a component block diagram illustrating an exemplary system formaintaining a searchable content repository.

FIG. 7 is an illustration of an exemplary computing device-readablemedium wherein processor-executable instructions configured to embodyone or more of the provisions set forth herein may be comprised.

FIG. 8 illustrates an exemplary computing environment wherein one ormore of the provisions set forth herein may be implemented.

DETAILED DESCRIPTION

The claimed subject matter is now described with reference to thedrawings, wherein like reference numerals are generally used to refer tolike elements throughout. In the following description, for purposes ofexplanation, numerous specific details are set forth in order to providean understanding of the claimed subject matter. It may be evident,however, that the claimed subject matter may be practiced without thesespecific details. In other instances, structures and devices areillustrated in block diagram form in order to facilitate describing theclaimed subject matter.

One embodiment of annotating content based upon user reaction data isillustrated by an exemplary method 100 in FIG. 1. At 102, the methodstarts. It may be appreciated that in one example, a user may requestand/or opt-in for user reaction data to be detected for the purpose ofannotating content (e.g., a user may desire to annotation images basedupon how the user reacted to the images, so that the user may latersearch for images based upon what emotions the images invoked in theuser, such as a search for happy images). The user may specify a levelof privacy for the user reaction data and/or annotation data (e.g., foruse by merely the user in organizing and/or searching for content basedupon how the user reacted to the content; for use in aggregatingannotation data in a searchable content repository available to varioususers; etc.).

At 104, first user reaction data associated with a first portion ofcontent may be detected. It may be appreciated that content may comprisea wide variety of electronic content, real-world (e.g., tangible)content, and/or experiences, such as a movie, an image, a shoppingstore, a park, a social network experience, an advertisement, anamusement park ride experience, an email, an individual (e.g., a phoneconversation with a boss or friend), a video game, a user interface,and/or a plethora of other types of content. The first reaction data maycomprise (e.g., data indicative of) a reaction by a user experiencingthe first portion of the content, such as emotional data (e.g.,contentment, anger, sadness, frustration, boredom, approval,disapproval, laughter, etc.). In one example, the first reaction datamay be detected in real-time during consumption of the first portion ofthe content by the user. In another example, one or more user reactionsmay be collected in real-time (e.g., by one or more sensors), but atleast some of these reactions may be processed at a different time(e.g., offline) to determine or detect the first reaction data. That is,for example, the first reaction data may be determined or detected fromone or more user reactions other than when the one or more userreactions occurred or were captured by one or more sensors on one ormore devices. Similarly, processing of one or more user reactions (e.g.,to determine or detect user reaction data) may be performed by one ormore devices other than the one or more devices that captured the one ormore user reactions. By way of example, user reactions such as bodymovement and/or speaking volume may be captured by a camera and/orspeaker on a smart phone and/or tablet device. Because processing theseuser reactions to determine or detect user reaction data may, amongother things, consume resources (e.g., CPU cycles, memory, batterypower, etc.), at least some of this processing may be performed on oneor more different devices, when the capturing device(s) is plugged in(e.g., as opposed to merely running on battery power), when resourceutilization of the capturing device(s) is low (e.g., performing few tono other operations), etc. Detecting or determining user reaction datausing a different device(s) and/or other than when user reaction(s)occur or are captured may, for example, allow processing to be performedmore efficiently, faster, with less resource utilization, etc. on acapturing device(s) that captured the user reaction(s) and/or on aprocessing device(s) that processes the user reaction(s), for example.

One or more sensors, such as a camera, a microphone, GPS, a motionsensing device, etc., may be selectively activated or deactivated basedupon various information, such as metadata associated with the firstportion of the content, a current time, a location context of a devicepresenting the content, contextual information of the content, etc. Inone example, a first sensor may be utilized to detect the first userreaction data based upon metadata associated with the first portion ofcontent. The metadata may specify that the first portion of the contenthas a reaction probability above a threshold (e.g., offline processingof a movie may indicate that a super hero defeating an enemy may invokeexcitement in a user, and thus a relatively high reaction probabilitymay be assigned to such a scene). In another example, a first sensor maybe selected from a set of available sensors based upon a resourceavailability associated with a device presenting the content (e.g., amicrophone, but not a camera, of a mobile phone may be selectivelyactivated to detect user reaction during a relatively long experiencewith a social network). In this way, one or more sensors may beselectively activated to detect user reaction data while experiencingcontent and/or portions thereof.

At 106, the first portion of the content may be annotated with a firstreaction annotation based upon the first user reaction data. Forexample, a first reaction annotation for a violent portion of a moviemay indicate that a user was upset while viewing the violent portion.Because the user may experience more than one emotion while watching theviolent portion of the movie, the first portion of the content may beannotated with one or more reaction annotations (e.g., a user reactionannotation indicating that the user became scared and unsettled whileviewing the violent portion of the movie).

In one example, the content may comprise more than one portion. Forexample, a movie may comprise one or more movie segments during whichuser reaction data may be detected. In this way, second user reactiondata associated with a second portion of the content may be detected.The second portion of the content may be annotated based upon the seconduser reaction data. In another example, the content may be annotatedwith an overall reaction annotation based upon one or more user reactiondata. For example, a comedy movie may receive an overall reactionannotation of bored even though at least one annotation for the comedymovie may comprise a reaction annotation that is different than a boredreaction annotation (e.g., the comedy movie may be annotated with somefunny reaction annotations, but may be annotated with a substantiallyhigher number of bored reaction annotations (e.g., that exceed athreshold value) and thus may receive the overall reaction annotation ofbored).

User reaction data for the content may be used to generate a userinterface that may convey user reaction information about the content.In one example, an overview for the content may be generated. Theoverview may comprise one or more portions of the content having atleast one reaction annotation (e.g., a trailer comprising one or moreemotional scenes from a movie). In this way, the overview may provide auser with a general idea (e.g., highlights) of the content. In anotherexample, a graph representing one or more reaction annotationsassociated with the content may be generated. Differing types ofreaction annotations may be visually differentiated within the graph(e.g., based upon color, labels, etc.). For example, a first type ofreaction annotation, such as sad, may be visually identified with afirst identifier (e.g., colored blue or represented by a frowning face)within the graph. A second type of reaction annotation, such as happy,may be visually identified with a second identifier (e.g., coloredyellow or represented by a smiling face) within the graph.

Annotation data associated with the content (e.g., reaction annotationsby a plurality of users) may be aggregated to generate aggregatedannotation data. The aggregated annotation data may identify how users(e.g., in general) reacted to the content and/or portions thereof. Asearch interface may allow users to perform reaction searches (e.g., apersonalized search for content that a particular user may have reactedto in a certain manner and/or a general search for content that usersmay have reacted to in a certain manner). For example, in response toreceiving a reaction search through the search interface, at least aportion of the content corresponding to the reaction search may beprovided based upon the aggregated annotation data (e.g., images thatmade a user happy; movies that made users scared; etc.). In this way,users may locate content (e.g., movies, images, locations) that may haveinvoked certain emotions within users. At 108, the method ends.

FIG. 2 illustrates an example of a system 200 configured for annotatingcontent based upon user reaction data. The system 200 may comprise adetection component 212 and/or an annotation component 224, which may beassociated with a device 204 (e.g., a computing device, a mobile phone,a tablet device, vehicle instrumentation, etc.) of a user 202. Thesystem 200 may comprise an opt-in component and/or the like, notillustrated, configured to activate or deactivate the detectioncomponent 212 and/or the annotation component 224 based upon whether theuser 202 requests and/or opts-in for detection and/or annotation ofcontent, for example.

The user 202 may experience content, such as movie content 214, throughthe device 204. The movie content 214 may comprise one or more portions,such as a first portion 206, a second portion 216, a third portion 218,and/or other portions not illustrated. For example, the user 202 may becurrently viewing a first portion 206 of the movie content 214. Metadata220 may be associated with the first portion 206 of the movie content214. In one example, the metadata 220 may specify that there is arelatively high reaction probability that a user may have a userreaction (e.g., express emotion) to the first portion 206 of the moviecontent 214. The metadata 220 may specify that a visual sensor is to beused to detect user reaction to the first portion 206 of the moviecontent 214. In this way, the detection component 212 may utilize avisual sensor of the device 204 to detect 208 first user reaction data210 (e.g., a happy emotion 222) associated with the first portion 206 ofthe movie content 214.

The annotation component 224 may be configured to annotate 226 the firstportion 206 of the movie content 214 with a first reaction annotation228 based upon the first user reaction data 210 (e.g., the happy emotion222). In one example, subsequent user reaction data for the firstportion 206 of the movie content 214 may be detected by the detectioncomponent 212. In this way, the annotation component 224 may annotatethe first portion 206 of the movie content 214 with one or more userreaction annotations. It may be appreciated that the detection component212 may detect and the annotation component 224 may annotate varioustypes of content, such as music, images, locations, venues, email,people, social network data, articles, books, blogs, etc., and are notlimited to merely movie content 214.

FIG. 3 illustrates an example of a system 300 configured for annotatingcontent based upon user reaction data. The system 300 may comprise anopt-in component and/or the like (not illustrated), a detectioncomponent 212, and/or an annotation component 224, which may beassociated with a device 204 of a user 202. It may be appreciated thatin one example, the system 300 may correspond to the system 200 of FIG.2. For example, the annotation component 224 may have annotated a firstportion 206 of movie content 214 based upon user reaction data (e.g., ahappy emotion) associated with the first portion 206 of the moviecontent 214. The movie content 214 may comprise one or more portions,such as the first portion 206, a second portion 216, a third portion218, and/or other portions not illustrated.

In one example, the user 202 may be currently viewing the second portion216 of the movie content 214. The detection component 212 may utilizeone or more sensors (e.g., a camera for visual, a microphone for audio,and/or a motion detection device for movement, etc.) to detect 302second user reaction data 304 (e.g., an angry emotion 306) associatedwith the second portion 216 of the movie content 214.

The annotation component 224 may be configured to annotate 308 thesecond portion 216 of the movie content 214 with a second reactionannotation 310 based upon the second user reaction data 304 (e.g., theangry emotion 306). In one example, subsequent user reaction data forthe second portion 216 of the movie content 214 may be detected by thedetection component 212. In this way, the annotation component 224 mayannotate the second portion 216 of the movie content 214 with one ormore user reaction annotations. It may be appreciated that the detectioncomponent 212 may detect and the annotation component 224 may annotatevarious types of content, such as music, images, locations, venues,email, people, social network data, etc., and are not limited to merelymovie content 214.

FIG. 4 illustrates an example of a system 400 configured for annotatingcontent based upon user reaction data 406. The system 400 may comprisean opt-in component and/or the like (not illustrated), a detectioncomponent 408, and/or an annotation component 412. The detectioncomponent 408 may be configured to detect user reaction data 406associated with content (e.g., state park content 416representing/identifying a real-world state park). In one example, auser 402 may be exploring a state park. The user 402 may be travelingwith a device 404, such as a mobile device (e.g., smart phone, tablet,etc.), while exploring the state park. The device 404 may comprisevarious sensors, such as a camera, a motion detector, a microphone,and/or other sensors. The detection component 408 may detect userreaction data 406 (e.g., sounds made by the user 402, movement of theuser 402, movement of the device 404 by the user, etc.) while the user402 is exploring the state park. In one example, metadata associatedwith the state park content 416 (e.g., metadata derived from offlineprocessing of outdoor geographic locations) may indicate when and/orwhat sensors that the detection component 408 is to activate ordeactivate, which may mitigate inefficient use of sensors (e.g.,activating all sensors during the entire exploration of the state parkmay undesirably drain battery resources of the device 404). For example,the metadata may specify that the motion detector and the microphone areto be activated responsive to a determination that the user 402 hasentered a particular portion of the state park (e.g., as indicated by aGPS device of the device 404), and that the camera is to be activatedwhen the motion detector determines that the user 402 has stoppedmoving.

In one example, the detection component 408 may determine that the userreaction data 406 indicates contentment 410 as an emotional state of theuser 402. The annotation component 412 may be configured to annotate 414the state park content 416 with a reaction annotation 418 indicative ofthe contentment 410 emotional state of the user 402 while exploring thestate park. In one example, supplemental content 420 (e.g., associatedwith the user 402 experiencing the state park content 416) may beobtained through the device 404. For example, the camera of the device404 may obtain a picture of the user 402 in the state park whileexpressing contentment 410. The annotation component 412 may associate422 the supplemental content 420 with the state park content 416 (e.g.,as an image 424 of the user 402 in the state park).

In this way, the user 402 and/or other users may organize, search for,and/or interact with the state park content 416 based upon the reactionannotation 418 and/or the supplemental content 420. For example, duringa stressful day at work, the user 402 may search through a searchinterface for content that invoked contentment (e.g., contentment 410)in the user 402. For example, the state park content 416 may be searchedto find one or more portions of content (e.g., corresponding toparticular portions of the state park) that resulted in contentment(e.g., a particular location in the park that yielded a substantiallyhigh level of contentment for one or more users). The search interfacemay provide a summary describing the state park, an overview (e.g., avideo trailer depicting the state park), a graph indicative of userreaction data for the state park content 416, the state park content416, and/or supplemental content (e.g., the image 424) based upon thesearch. For example, the search interface may provide a summary of thestate park content 412, the image 424 of the user in the state park,and/or other data associated with the state park content 412 (e.g., thatmay assist the user in visiting a particular aspect of the state parkthat the user may find soothing).

One embodiment of maintaining a searchable content repository isillustrated by an exemplary method 500 in FIG. 5. At 502, the methodstarts. At 504, annotated data associated with content may be aggregatedfrom a plurality of users to generate aggregated annotation data. Forexample, advertisement content corresponding to an advertisement may beexperienced by one or more users. User reaction data may be detectedwhile such users experience the advertisement content (e.g., theadvertisement may invoke boredom in a first user, indifference in asecond user, boredom in a third user, confusion in a fourth user, etc.).The advertisement content may be annotated with one or more reactionannotations based upon the user reaction data. Annotation data for theadvertisement content may comprise such reaction annotations (e.g.,boredom, indifference, confusion, etc.). The annotation data may beaggregated to generate aggregated annotation data for the advertisementcontent (e.g., in general, users are bored by the advertisement).

A search interface may allow users to locate and/or consume content. Forexample, a user reaction search may be received through the searchinterface (e.g., during a lecture, a marketing teacher may submit asearch for advertisements that invoke boredom in viewers). Accordingly,at least a portion of content that corresponds to the user reactionsearch may be provided based upon the aggregated annotation data. Inanother example, a single user reaction search may be received throughthe search interface (e.g., an advertising manager may search foradvertisements that were annotated as boring to the advertisingmanager). Accordingly, at least a portion of content that corresponds tothe single user reaction search may be provided. In this way, a user maysearch for content based upon aggregated user reactions to the contentand/or based upon how the user reacted to the content.

FIG. 6 illustrates an example of a system 600 configured for maintaininga searchable content repository 610. The system 600 may comprise asearch component 608. The search component 608 may be associated withthe searchable content repository 610. The searchable content repository610 may comprise content that may have been annotated with reactionannotations and/or associated with supplementary content. For example,the searchable content repository 610 may comprise comedy movie content612, bill payment website content 616, and/or other content notillustrated. In one example, the comedy movie content 612 may beannotated with one or more reaction annotations of a user (e.g., asingle user annotation for the entire movie, a single user annotationfor a first scene, a single user annotation for a second scene, and/orother single user annotations). The comedy movie content 612 may beassociated with aggregated annotation data (e.g., an overall userreaction for the entire movie, an overall user reaction to the firstscene, an overall user reaction to the second scene, and/or otheraggregated annotations). The comedy movie content 612 may be associatedwith supplemental content 614. For example, the supplemental content 614may comprise a video of a user providing a summary of the comedy moviecontent 612. In this way, the searchable content repository 610 maycomprise annotated content that may be retrieved by the search component608.

The search component 608 may be associated with a search interface 602.The search interface 602 may provide an interface through which usersmay submit various types of searches. For example, the search interface602 may provide an interface through which users may submit single userreaction searches by a particular user (e.g., search single userannotations 604, such as a search for images that made a user laugh)and/or submit user reaction searches (e.g., search aggregatedannotations 606, such as a search for videos that made users sad). Thesearch component 608 may be configured to receive a search 608 submittedthrough the search interface 602. The search component 608 may searchthe searchable content repository 610 for content 618, supplementalcontent 620, and/or other information (e.g., a summary, an overview, agraph, etc.) corresponding to the search 608. In this way, the searchcomponent 608 may present search results based upon information withinthe searchable content repository (e.g., videos that made users sad, atrailer for a sad movie, user reviews for sad movies, etc.).

Still another embodiment involves a computing device-readable mediumcomprising processor-executable instructions configured to implement oneor more of the techniques presented herein. An exemplary computingdevice-readable medium that may be devised in these ways is illustratedin FIG. 7, wherein the implementation 700 comprises a computingdevice-readable medium 716 (e.g., a CD-R, DVD-R, or a platter of a harddisk drive), on which is encoded computing device-readable data 714.This computing device-readable data 714 in turn comprises a set ofcomputing device instructions 712 configured to operate according to oneor more of the principles set forth herein. In one such embodiment 700,the processor-executable computing device instructions 712 may beconfigured to perform a method 710, such as at least some of theexemplary method 100 of FIG. 1 and/or at least some of exemplary method500 of FIG. 5, for example. In another such embodiment, theprocessor-executable instructions 712 may be configured to implement asystem, such as at least some of the exemplary system 200 of FIG. 2, atleast some of the exemplary system 300 of FIG. 3, at least some of theexemplary system 400 of FIG. 4, and/or at least some of the exemplarysystem 600 of FIG. 6, for example. Many such computing device-readablemedia may be devised by those of ordinary skill in the art that areconfigured to operate in accordance with the techniques presentedherein.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims.

As used in this application, the terms “component,” “module,” “system”,“interface”, and the like are generally intended to refer to a computingdevice-related entity, either hardware, a combination of hardware andsoftware, software, or software in execution. For example, a componentmay be, but is not limited to being, a process running on a processor, aprocessor, an object, an executable, a thread of execution, a program,and/or a computing device. By way of illustration, both an applicationrunning on a controller and the controller can be a component. One ormore components may reside within a process and/or thread of executionand a component may be localized on one computing device and/ordistributed between two or more computing devices.

Furthermore, the claimed subject matter may be implemented as a method,apparatus, or article of manufacture using standard programming and/orengineering techniques to produce software, firmware, hardware, or anycombination thereof to control a computing device to implement thedisclosed subject matter. The term “article of manufacture” as usedherein is intended to encompass a computing device program accessiblefrom any computing device-readable device, carrier, or media. Of course,those skilled in the art will recognize many modifications may be madeto this configuration without departing from the scope or spirit of theclaimed subject matter.

FIG. 8 and the following discussion provide a brief, general descriptionof a suitable computing environment to implement embodiments of one ormore of the provisions set forth herein. The operating environment ofFIG. 8 is only one example of a suitable operating environment and isnot intended to suggest any limitation as to the scope of use orfunctionality of the operating environment. Example computing devicesinclude, but are not limited to, personal computing devices, servercomputing devices, hand-held or laptop devices, mobile devices (such asmobile phones, Personal Digital Assistants (PDAs), media players, andthe like), multiprocessor systems, consumer electronics, mini computingdevices, mainframe computing devices, distributed computing environmentsthat include any of the above systems or devices, and the like.

Although not required, embodiments are described in the general contextof “computing device readable instructions” being executed by one ormore computing devices. Computing device readable instructions may bedistributed via computing device readable media (discussed below).Computing device readable instructions may be implemented as programmodules, such as functions, objects, Application Programming Interfaces(APIs), data structures, and the like, that perform particular tasks orimplement particular abstract data types. Typically, the functionalityof the computing device readable instructions may be combined ordistributed as desired in various environments.

FIG. 8 illustrates an example of a system 810 comprising a computingdevice 812 configured to implement one or more embodiments providedherein. In one configuration, computing device 812 includes at least oneprocessing unit 816 and memory 818. Depending on the exact configurationand type of computing device, memory 818 may be volatile (such as RAM,for example), non-volatile (such as ROM, flash memory, etc., forexample) or some combination of the two. This configuration isillustrated in FIG. 8 by dashed line 814.

In other embodiments, device 812 may include additional features and/orfunctionality. For example, device 812 may also include additionalstorage (e.g., removable and/or non-removable) including, but notlimited to, magnetic storage, optical storage, and the like. Suchadditional storage is illustrated in FIG. 8 by storage 820. In oneembodiment, computing device readable instructions to implement one ormore embodiments provided herein may be in storage 820. Storage 820 mayalso store other computing device readable instructions to implement anoperating system, an application program, and the like. Computing devicereadable instructions may be loaded in memory 818 for execution byprocessing unit 816, for example.

The term “computing device readable media” as used herein includescomputing device storage media. Computing device storage media includesvolatile and nonvolatile, removable and non-removable media implementedin any method or technology for storage of information such as computingdevice readable instructions or other data. Memory 818 and storage 820are examples of computing device storage media. Computing device storagemedia includes, but is not limited to, RAM, ROM, EEPROM, flash memory orother memory technology, CD-ROM, Digital Versatile Disks (DVDs) or otheroptical storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or any other medium which canbe used to store the desired information and which can be accessed bydevice 812. Any such computing device storage media may be part ofdevice 812.

Device 812 may also include communication connection(s) 826 that allowsdevice 812 to communicate with other devices. Communicationconnection(s) 826 may include, but is not limited to, a modem, a NetworkInterface Card (NIC), an integrated network interface, a radio frequencytransmitter/receiver, an infrared port, a USB connection, or otherinterfaces for connecting computing device 812 to other computingdevices. Communication connection(s) 826 may include a wired connectionor a wireless connection. Communication connection(s) 826 may transmitand/or receive communication media.

The term “computing device readable media” may include communicationmedia. Communication media typically embodies computing device readableinstructions or other data in a “modulated data signal” such as acarrier wave or other transport mechanism and includes any informationdelivery media. The term “modulated data signal” may include a signalthat has one or more of its characteristics set or changed in such amanner as to encode information in the signal.

Device 812 may include input device(s) 824 such as keyboard, mouse, pen,voice input device, touch input device, infrared cameras, video inputdevices, and/or any other input device. Output device(s) 822 such as oneor more displays, speakers, printers, and/or any other output device mayalso be included in device 812. Input device(s) 824 and output device(s)822 may be connected to device 812 via a wired connection, wirelessconnection, or any combination thereof. In one embodiment, an inputdevice or an output device from another computing device may be used asinput device(s) 824 or output device(s) 822 for computing device 812.

Components of computing device 812 may be connected by variousinterconnects, such as a bus. Such interconnects may include aPeripheral Component Interconnect (PCI), such as PCI Express, aUniversal Serial Bus (USB), firewire (IEEE 1394), an optical busstructure, and the like. In another embodiment, components of computingdevice 812 may be interconnected by a network. For example, memory 818may be comprised of multiple physical memory units located in differentphysical locations interconnected by a network.

Those skilled in the art will realize that storage devices utilized tostore computing device readable instructions may be distributed across anetwork. For example, a computing device 830 accessible via a network828 may store computing device readable instructions to implement one ormore embodiments provided herein. Computing device 812 may accesscomputing device 830 and download a part or all of the computing devicereadable instructions for execution. Alternatively, computing device 812may download pieces of the computing device readable instructions, asneeded, or some instructions may be executed at computing device 812 andsome at computing device 830.

Various operations of embodiments are provided herein. In oneembodiment, one or more of the operations described may constitutecomputing device readable instructions stored on one or more computingdevice readable media, which if executed by a computing device, willcause the computing device to perform the operations described. Theorder in which some or all of the operations are described should not beconstrued as to imply that these operations are necessarily orderdependent. Alternative ordering will be appreciated by one skilled inthe art having the benefit of this description. Further, it will beunderstood that not all operations are necessarily present in eachembodiment provided herein.

Moreover, the word “exemplary” is used herein to mean serving as anexample, instance, or illustration. Any aspect or design describedherein as “exemplary” is not necessarily to be construed as advantageousover other aspects or designs. Rather, use of the word exemplary isintended to present concepts in a concrete fashion. As used in thisapplication, the term “or” is intended to mean an inclusive “or” ratherthan an exclusive “or”. That is, unless specified otherwise, or clearfrom context, “X employs A or B” is intended to mean any of the naturalinclusive permutations. That is, if X employs A; X employs B; or Xemploys both A and B, then “X employs A or B” is satisfied under any ofthe foregoing instances. In addition, the articles “a” and “an” as usedin this application and the appended claims may generally be construedto mean “one or more” unless specified otherwise or clear from contextto be directed to a singular form. Also, at least one of A and B and/orthe like generally means A or B or both A and B.

Also, although the disclosure has been shown and described with respectto one or more implementations, equivalent alterations and modificationswill occur to others skilled in the art based upon a reading andunderstanding of this specification and the annexed drawings. Thedisclosure includes all such modifications and alterations and islimited only by the scope of the following claims. In particular regardto the various functions performed by the above described components(e.g., elements, resources, etc.), the terms used to describe suchcomponents are intended to correspond, unless otherwise indicated, toany component which performs the specified function of the describedcomponent (e.g., that is functionally equivalent), even though notstructurally equivalent to the disclosed structure which performs thefunction in the herein illustrated exemplary implementations of thedisclosure. In addition, while a particular feature of the disclosuremay have been disclosed with respect to only one of severalimplementations, such feature may be combined with one or more otherfeatures of the other implementations as may be desired and advantageousfor any given or particular application. Furthermore, to the extent thatthe terms “includes”, “having”, “has”, “with”, or variants thereof areused in either the detailed description or the claims, such terms areintended to be inclusive in a manner similar to the term “comprising.”

What is claimed is:
 1. A content annotation method, comprising:identifying a portion of content that for which there is a signal of ahigh probability that a user will experience a reaction to the portionof the content, the signal being derived from data associated with thecontent; determining one or more inputs, from an available set of inputsassociated with the content, to activate based on data associated withthe portion of the content; receiving an input from the available set ofinputs based on data associated with the portion of the content;receiving, utilizing the received input, data of a user's reaction whileexperiencing the portion of the content, after the identifying;formulating a reaction annotation corresponding to the received data;and annotating the portion of the content with a reaction annotation. 2.The method of claim 1, wherein the receiving is performed only afterreceipt of an indication to permit detection of data of the user'sreaction while experiencing the portion of the content.
 3. The method ofclaim 1, wherein the receiving comprises detecting data in real-time andduring consumption of the portion of the content by the user.
 4. Themethod of claim 1, further comprising: detecting data of another user'sreaction while experiencing the portion of content, after theidentifying; aggregating the another user's detected data; formulatinganother reaction annotation corresponding to the detected data for theanother user's detected data; and annotating the portion of the contentwith the another reaction annotation.
 5. The method of claim 1, furthercomprising generating, based at least on the received data, a userinterface that by which user reaction data is conveyable.
 6. The methodof claim 1, wherein the receiving comprises detecting data using one ormore sensors of a device presenting the content, based upon a resourceavailability associated with the device.
 7. The method of claim 1,wherein the annotation is a visual element of one of a heatmap and agraph, each depicting one or more reaction annotations associated withthe content and in which different types of reaction annotations, whenpresent, are presented in different visual manners.
 8. The method ofclaim 1, wherein the receiving comprises selecting a sensor from anavailable set of sensors to detect at least some of the data of a user'sreaction, the selecting being based upon at least one of a current time,a location context of a device presenting the content, a context of thecontent, or metadata specifying a type of sensor for the content.
 9. Themethod of claim 8, further comprising selectively activating ordeactivating the sensor based upon metadata associated with the portionof the content.
 10. The method of claim 1, further comprising generatinga graph representing reaction annotations associated with the portion ofthe content in which different types of the reaction annotations arevisually differentiated.
 11. The method of claim 10, further comprising:identifying a first type of reaction annotation with a first visual cuewithin the graph; and identifying a second type of reaction annotationwith a second visual cue within the graph, wherein the first and secondvisual cues differ.
 12. The method of claim 1, further comprising:utilizing a sensor to obtain supplemental content associated with anexperience of the user with the portion of the content; and associatingthe supplemental content with the portion of the content.
 13. A contentannotation method, comprising: evaluating data about a media content toyield a determination of whether a portion of the media content has arequisite probability that a user experiencing the portion will have areaction to it; receiving, utilizing an activated sensor from a set ofavailable sensors, user reaction data which is associated with aspecified portion of the media content when the determination isaffirmative, the activated sensor having been activated based onmetadata associated with the specified portion of content; andannotating the specified portion of the media content with a reactionannotation that corresponds to the received user reaction data.
 14. Themethod of claim 13, wherein the reaction annotation also reflects anaggregation of more than one user's detected user reaction data.
 15. Themethod of claim 13, further comprising generating, based at least on thereceived user reaction data, a user interface that is adapted andconfigured to convey user reaction data.
 16. The method of claim 13,wherein the receiving includes using one or more sensors of a devicepresenting the media content.
 17. The method of claim 16, furthercomprising selecting the one or more sensors from an available set,based upon a resource availability associated with a device presentingthe media content.
 18. A content annotation method, comprising:identifying a portion of content that for which there is an indicationof a high probability that a user will experience a reaction to theportion of the content, the indication being in data about the content;selectively activating a sensor based upon metadata associated with theportion of the content; detecting, utilizing the activated sensor, dataof a user's reaction while experiencing the portion of the content,after the identifying; formulating a reaction annotation correspondingto the detected data; receiving an indication limiting use of one orboth of the detected data or the reaction annotation; and annotating theportion of the content with a reaction annotation in a manner consistentwith the indication.
 19. The method of claim 18, wherein the annotatingcomprises generating one of a heatmap and a graph, each depicting one ormore reaction annotations associated with the portion of the content.20. The method of claim 19, wherein, in at least one of the heatmap andthe graph, different types of the reaction annotations, when present,are visually differentiated.